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Abstract 

ECML PKDD is the main European conference on machine learning 
and data mining. Since its foundation it implemented the publication 
model common in computer science: there was one conference deadline; 
conference submissions were reviewed by a program committee; papers 
were accepted with a low acceptance rate. Proceedings were published in 
several Springer Lecture Notes in Artificial (LNAI) volumes, while selected 
papers were invited to special issues of the Machine Learning and Data 
Mining and Knowledge Discovery journals. In recent years, this model 
has however come under stress. Problems include: reviews are of highly 
variable quality; the purpose of bringing the community together is lost; 
reviewing workloads are high; the information content of conferences and 
journals decreases; there is confusion among scientists in interdisciplinary 
contexts. In this paper, we present a new publication model, which will 
be adopted for the ECML PKDD 2013 conference, and aims to solve some 
of the problems of the traditional model. The key feature of this model is 
the creation of a journal track, which is open to submissions all year long 
and allows for revision cycles. 



1 Introduction 

We propose a new conference/journal publication model, the main feature of 
which is the creation of a journal track that allows all-year submissions to the 
conference. We would like to adopt this model at ECML PKDD 2013, but hope 
it will be useful beyond this conference. We start this text with arguments why 
a new model is needed. Next, we summarize the goals we wish to achieve, and 
the basic ideas underlying our model. We end with a detailed description of 
how we intend to implement it. 



2 Motivation 

Computer Science is atypical as a scientific field, in that it focuses on publishing 
at conferences, rather than journals. There is a growing discontent, internation- 
ally and in various subfields of computer science, with this tradition. Many 
argue that the conference-oriented publication system has reached its limits, 
and is breaking down. See the Appendix [X] and the bibliography for detailed 
arguments. In particular the ideas of Halpern and Parkes (2011) are very sim- 
ilar to ours. Briefly, in its current form, the system leads to reviews of highly 
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variable quality; proliferation of conferences (such that the main purpose of con- 
ferences, bringing the community together, is lost); high reviewing workloads; 
slower reviewing for journals; decrease of information content of conferences and 
journals alike; lengthy journal articles; confusion among scientists in interdisci- 
plinary contexts; unfair evaluations of academics. 

The model adopted in most other domains of research, where conferences 
serve as community meetings and journals as the main publication channel, suf- 
fers less from the above shortcomings. Full papers are reviewed more thoroughly, 
with multiple reviewing rounds when necessary; there is less confusion about the 
expected standards; there is no artificial limit on the number of submissions that 
can be accepted; the total reviewing workload is lower (fewer different versions 
of papers are reviewed) ; journal articles are more concise (they need not "signif- 
icantly extend" previous full-length versions). The main problem with journals, 
in computer science, seems to be the processing time: journal reviewing tends 
to take much longer than conference reviewing. 

There have been several initiatives to address these issues. ECMLPKDD 
has experimented with selecting papers for exclusive publication in journals; 
this resolves some of the mentioned issues, but not all. SIGGRAPH and ICLP 
have taken similar initiatives to directly publish conference papers in journals. 
IJCAIT3 will have a track in which Journal of Artificial Intelligence Research 
articles will be presented that were not published in any form at a conference. 
Several conferences (AAAI, IJCAI, ECMLPKDDT2) arc introducing NECTAR 
tracks in which important papers published in related communities can be pre- 
sented. VLDB has moved to a journal-reviewing-like model. Changes towards 
different publication models have been considered for ICML and NIPS, but have 
not been implemented up till the 2012 editions. ACMLT2 has introduced a sys- 
tem with two yearly submission deadlines for the conference track, allowing for 
resubmissions. The ACL conference on computational linguistics has moved to 
the VLDB system from 2012. 

3 Goals 

The model that we propose for ECML PKDD 2013, aims at achieving four main 
goals. 

1. Further increase the quality of full paper presentations at the 
conference, by improving the quality of reviewing and providing more 
visibility to top contributions at the conference. 

2. Further increase the quality of journals, by evaluating a new model 
for journal reviewing that combines quality with speed. 

3. Make the conference more inclusive, by allowing for a broader set 
of contributions to be presented at the conference, albeit not as journal 
publications. 

4. Reduce the "conference versus journal" dilemma that authors face. 

Even though our goals are ambitious, we would like the implement the new 
system by the smallest possible changes to the current ECMLPKDD system. 
These changes are 
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1. safe: the current procedures for conference and journal reviewing remain 
in place, we only install an alternative track; 

2. small: the alternative track is quite similar in spirit to previous ideas of 
selecting papers for inclusion into a journal directly; 

3. advantageous, both to the ECML/PKDD conference as to the journals 
taking part in the initiative (MLj, DMKD). 

The model is similar to the VLDB publication model, which is increasingly 
known within the computer science community. 

4 Concepts of the Proposed System 

The starting point of our proposal is that journal reviewing systems are the 
standard for high quality reviewing. The journal system has the following key 
distinguishing features: 

• articles can go through iterations of revisions before being accepted; 

• there is no submission deadline: articles can be submitted, evaluated, 
and accepted all year long; 

• reviewing for journals is typically done by senior researchers, who arc 

rewarded for this by the prestige of being member of an editorial board. 

We would like to see these principles applied to good conference publications 
as well. The easiest way to do this is to simply use the journal reviewing system 
for the conference. That is: authors who submit to the journal, can indicate 
that they would like to have their article considered for presentation at the 
conference. Submissions that are accepted, are then automatically accepted for 
the conference as well. The authors can thus draw additional attention to their 
work. Submissions may be considered not mature enough for publication in 
the journal, but interesting enough for presentation at the conference; these are 
again automatically accepted for the conference, without additional reviewing. 

However, to make this successful, we need to ensure that the revision and 
reviewing cycles are short. Indeed, the duration of journal reviewing is a major 
reason, for many researchers, for preferring conference publication. We intend 
to achieve this by introducing some efficiency-increasing ideas from conference 
reviewing into the journal reviewing process. 

These arguments could entail a solution in which ECMLPKDD publishes all 
contributions in one or more scientific journals. That is the VLDB model. We 
believe this may be a too big step for ECMLPKDD at this point; it may require 
increasing the capacity of existing journals, or the creation of new ones. Our 
initiative is intended to be a first, easily achievable step in this direction. 

5 Technical Details 

The proposed ECML PKDD submission system will have two tracks: 
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• a proceedings track, which will have one deadline as usual, and whose 
proceedings will be published in lecture notes; a program committee will 
review these papers; 

• a journal track, which will allow for submissions all year long, and whose 
articles will be published either in the machine learning or data mining 
journals, or in the lecture notes; a guest editorial board will review these 
papers. 

At this moment, ECML PKDD's proceedings track will not be modified signif- 
icantly. The main change is the introduction of a journal track. Only papers 
submitted to the journal track can enter the machine learning and data min- 
ing journals. Papers that are not of journal quality, but of good conference 
quality, will be considered for inclusion in the proceedings even if submitted 
to the journal. Accepted papers are immediately published online, either us- 
ing the journal's Online First facility, or on the conference website (until the 
proceedings are there) We are considering to mark papers that end up in the 
proceedings after journal quality reviewing. The benefits for submitting to the 
journal track are the following: 

• papers can be submitted all year long; the possibility to resubmit gives 
authors a higher chance of presenting their work at ECML PKDD, while 
the repeated reviewing cycles should ensure the quality of the papers; 

• multiple iterations of the same paper will be reviewed by the same review- 
ers, which should reduce the reviewing efforts; 

• papers will receive higher quality reviews, as the reviewing process is car- 
ried out by senior researchers; 

• papers are available online almost immediately after acceptance (whether 
for journal or conference). 

In detail, we propose the following setup. 

Guest Editorial Board A Guest Editorial Board (GEB) will be appointed 
for the duration of one year, consisting of members of the editorial board of 
the machine learning and data mining journals, as well as additional senior 
researchers. GEB members will agree to the following: 

• timely reviewing of a limited number of articles that will be sent to them 
over the course of one year; 

• monitoring of their performance. 

Monitoring reviewer's performance is expected to be important to ensure a 
timely reviewing process. The process will however be lenient to reviewers 
as long as the chairs are notified in advance. If reviewers do not meet their 
deadlines and do not notify the chairs well in advance, the assumption is that 
they will not be invited for next year's GEB. In the following, asterisks indicate 
points that will count towards positive or negative evaluation of GEB members. 

1 This idea is subject to approval from Springer. 
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Note that we explicitly do not limit the size of the GEB in advance. Even 
though we will start with a relatively small GEB, we intend to grow the editorial 
board as needed, depending on the popularity of the journal track. Our aim is 
to limit the number of articles that each GEB member has to review to at most 
5. 

Submission Procedure We envision the following submission procedure: 

1. There is a deadline on Sunday night, every two weeks. 

2. The list of submissions is sent immediately to the GEB on Monday morn- 
ing. Each member will receive a personalized mail that contains the fol- 
lowing: 

• an overview of the number of articles he/she reviewed; 

• an average of the number of articles other editorial board members 
reviewed (once this number is high enough); 

• a list of submitted articles (titles & abstracts), each with a direct link 
on which the GEB member can click to show interest in this article.* 

Furthermore, each GEB member will have the opportunity to post a com- 
ment on a submitted paper; these comments will not be shown to the 
authors, but can be seen as suggestions to the final reviewers; for in- 
stance, such a comment could be: "this reminds me of the work by author 
A, the reviewers should check this" .* 

3. Based on these bids, the paper is manually assigned to reviewers on Friday, 
taking into account possible conflicts of interests. Papers that did not 
receive a sufficient number of bids, will be allocated a reviewer. 

4. The GEB member should accept or decline the task within the next week.* 

5. The GEB member has 4 weeks for reviewing after being invited to review 
the paper, the deadline being on Friday. 

6. On Wednesday morning before the deadline, the GEB member is reminded 
by email of the approaching deadline. The GEB member can request an 
extension of one week by reacting to this mail before Friday. 

7. Any paper for which no response is received* is immediately allocated to 
another reviewer. 

8. The chairs aim to decide within one week whether the article can be 
published in the journal. If positive, this decision is communicated to 
the editor-in-chief or a responsible action editor, who has to agree before 
the authors are notified. Accepted papers will be published online as soon 
as possible. 

Overall, this would result in a turn around time of only 6 to 8 weeks. The 
VLDB experience suggests that this is realistic. 

The last deadline that will allow for publication in the ECML PKDD 2013 
journal track will be approximately 7 weeks before the deadline of the conference 
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track. However, the chairs will not promise that reviewing will be finished within 
7 weeks - authors are recommended to submit sufficiently early. 

Note that the ECML PKDD program chairs will decide on accepted papers 
both for the conference and the journal track. They will ensure that papers in 
both tracks have the desired quality; the editors-in-chief of the journals cannot 
autonomously decide to accept a paper in the conference track. 

Ratings Reviewers will be given the opportunity to mark papers as follows: 

1. Accept immediately in the journal. 

2. Accept for the conference proceedings, but request revisions for the journal 
track. 

3. Request revisions and allow resubmission to the journal track. 

4. Reject. 

In case a paper is rated (2), the authors will have to indicate whether they intend 
to resubmit to the journal track. If not, the paper will enter the procedure for 
a final version in the conference proceedings. 

In case a paper is rated (3), the authors are also allowed to resubmit their 
paper to the conference track instead of the journal track. After the last ECML 
PKDD 2013 journal track deadline has passed, this will be the only possible 
way to publish their results at ECML PKDD 2013. Such submissions will be 
reviewed by the GEB members that reviewed the original submission. 

In case a paper is rated (4), the paper will also not be accepted to the 
conference track. 

Format of Submissions Articles submitted to the journal track will have to 
be of journal quality. Hence, if experimental in nature, they will have to contain 
a sufficient number of experiments; if theoretical in nature, they will have to 
provide full proofs of their claims. 

It will be possible to submit articles of any length to the journal track. How- 
ever, only articles that adhere to a page limit of 20 pages in journal (DAMI/MLJ) 
style will be evaluated using the above described process, and will hence receive 
short review times. Articles beyond 20 pages will be treated as normal submis- 
sions to the corresponding journals; they cannot be forwarded to the proceedings 
and will typically not be reviewed in a short time. 

By not imposing an overall page limit, we ensure that the quality of journal 
articles is not limited. At the same time, we do not believe it is reasonable to 
expect from reviewers that they provide high quality reviews for long papers 
within a short time. 

We will encourage all authors to publish their full versions also in arXiv/CoRR, 
and aim to have permissions for this from Springer. 

Relationships to the Proceedings Track The proceedings track and the 
journal track clearly are not completely independent of each other. In particular, 
articles that are not revised in time for the journal track, may be resubmitted 
to the proceedings track. However, to reduce the reviewing load, such resub- 
missions from the journal track will be reviewed by the GEB members that 
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reviewed the original submission. The number of reviews carried out by an 
GEB member will be recorded and taken into account when allocating proceed- 
ings submissions to reviewers; reviewers that reviewed a significant number of 
journal articles will not be asked to review proceedings submissions. Neverthe- 
less, they will also be listed as members of the program committee; the program 
committee will automatically include all GEB members. 

Further Changes to the Proceedings Track There will be a separate 
deadline for the proceedings track. The setup of the proceedings track, such as 
its acceptance rate and its reviewing procedures (whether or not to have author 
response, ...) are in principle independent from the setup of the journal track. 
It would however be in the spirit of our proposal to accept a larger number 
of papers to the proceedings track and to reduce the selective pressure for this 
track. Other tracks, such as a demo track, an industrial track, or Nectar track, 
are under consideration. 

6 Future Directions 

We envision that the system can evolve in several directions after ECMLP- 
KDDT3. 

A specialized journal ECMLPKDD can adopt the VLDB model and found a 
journal specific for ECMLPKDD, preferably open access in nature. This journal 
could be used for all full paper submissions; this journal may be indexed by 
conference indexing services to track the impact of ECMLPKDD. The present 
conference track reduces to a session for posters and short presentations on 
ongoing work. 

Additional conferences join the system The ML and DMKD journals 
continue to receive submissions for ECMLPKDD, but other conferences start 
using ECMLPKDD's procedure, effectively establishing an ECMLPKDD re- 
viewing system in collaboration with these journals. At each resubmission the 
authors can indicate to which conference they wish to resubmit, allowing papers 
that not were not finished in time for ECMLPKDD to be considered in other 
conferences. 

Additional journals join the system To increase the number of papers 
that ECMLPKDD can publish in established journals, it may be an option that 
more journals are allowed to join the system (a special purpose ECMLPKDD 
journal possibly being one of them). Based on the reviews, the chairs of the 
reviewing system allocate papers to journals; this is similar to conferences in 
bioinformatics, which nowadays often have special issues in many journals. 

The Old System When our proposal is a failure, the journal track can be 
abolished and the conference track's acceptance rate can be decreased again. 

Key to our proposal is that it can evolve in each of these directions, based on 
the evolution of the field as a whole in the coming years. 
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A Arguments against the Conference System 

The tables below summarize the arguments made against the conference system 
by several well-known computer scientists. 
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Reference: Fort now (2Q0||) 
Credentials author: 

• Founding editor-in-chief of the ACM Transaction on Computation Theory 

• Chair of ACM SIGACT 

• Chair of the IEEE Conference on Computational Complexity 
Observations: 

• Rating researchers based on conferences is too random 

• The number of conferences is so large each individual one no longer brings 
together communities 

• Conferences can no longer accept all high-quality work 

• For papers on the margin, there is now a bias for "safe" papers (incremental and 
technical) and certain subareas (researchers from top CS departments dominate 
PCs and set the agendas) 

• Collaboration with researchers in other fields is hard due to having different 
publication procedures 

• Papers get rejected due to simple misunderstandings 



Reference: IVardil l|2009l . |2010| ) 
Credentials author: 

• Editor-in-chief of the Communications of the ACM 
Observations: 

• The computer science conference system compromises one of the cornerstones 
of scientific publication: peer review 

• The reviewing process performed by program committees is done under extreme 
time and workload pressure, and does not rise to the level of careful refereeing 

• The long turnaround times for journal articles is one important reason why 
computer science does not switch to a journal-oriented model; in other areas, 
the turnaround time is much lower 

• The conference-focused publication culture can not be separated from the slug- 
gish journal editorial process. Roles as editors and referees are not taken as 

seriously as PC memberships 



Reference: ICrudinl <|2010l ) 
Credentials author: 

• Former editor-in-chief of the ACM Transactions on Computer-Human Interac- 
tion 

• Associate Editor of ACM Computing Surveys 
Observations: 

• A focus on conference publication has led to deadline-driven short-term research 
at the expense of journal publication, a reviewing burden that can drive off 
prominent researchers, and high rejection rates that favor cautious incremental 
results over innovative work 

• In other fields, journals focus on identifying and improving research quality; 
large conferences focus on community building: people don't retain quite the 
same warm feeling when their work is rejected 

• With pressure to reject fn 75% and differing views of what constitutes significant 
work, the minor flaws or literature omissions that inevitably accompany novel 
work become grounds for exclusion 

• It is increasingly difficult to evolve conference papers into journal articles. By 
Grudin's estimation, no more than 15% of the work published in highly selective 
HCI conferences later appears in journals 



Table 1: Arguments against the current conference-oriented publication model 
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Reference: Birman and Schneider (2009) 
Credentials authors: 

• Former editor-in-chief of the ACM Transactions on Computer Systems 

• Former editor-in-chief of Distributed Computing 

• Associate editor-in-chief IEEE Security and Privacy 
Observations: 

• Major conferences are overwhelmed by submissions 

• The conference system leads to more publications per researcher and per project, 
even though the aggregate scientific content of all these papers is likely the same 
as one journal article 

• Authors submit almost any paper to almost any conference, because acceptance 
will advance their research and career goals; rejection does them virtually no 
harm 

• The more innovative papers are the most likely to be either completely misun- 
derstood or underappreciated by an increasingly error-prone process 

• There is a risk of a "death spiral" as senior people cease to review. Young re- 
searchers often feel more comfortable identifying minor flaws and are less com- 

fortable in declaring that work is more or less important 

Reference: iNauehtonl (|2010T ) 
Credentials author: 

• Keynote speaker at ICDETO 

• Associate Editor of VLDB Journal 

• Associate Editor of ACM Transactions on Database Systems 
Observations: 

• The combination of pressure to publish lots of papers, low acceptance rates, and 
bad reviewing, is sucking the air out of our community 

• The conference system is often seen as an evaluation system for authors; in this 
sense, it can be compared to studying for and taking college entrance exams: 
'students' (authors) are not that interested in the questions, the 'graders' (re- 
viewers) are even less interested in the answers, no-one else is interested either, 
caring only about the scores 

• Emphasis on paper count can be somewhat ameliorated by increasing acceptance 
rate: if it is easier to publish papers, publishing lots of them will be perceived 
as less impressive; shifts the focus from paper count to paper quality 

• SIGMOD 2010 received 350 submissions, 1 with uniform "accept" recommen- 
dations, 4 with average "accept" 

• Receiving dysfunctional reviews begets writing dysfunctional reviews 

• Due to the absence of face-to-face PC meetings, there is less accountability 
pressure; there is fewer coaching and mentoring 

• If you get a 'killer' reviewer, you are dead; so you resubmit until you have three 
non-killers 



Table 2: Arguments against the current conference-oriented publication model 
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Reference: Jagadish (2008) 



Credentials author: 

• Founding editor-in-chief of the Proceedings of the Very Large Database Endow- 
ment (PVLDB) 

• Program Chair of the International Conference on Intelligent Systems for Molec- 
ular Biology (ISMB), 2005 

• Editor for the database section of the Computing Research Repository (CoRR) 
Observations: 

• The number of submissions to many conferences has sky-rocketed, leading to a 
downward spiral in reviewing quality and author satisfaction 

• The enormous size of program committees leads to huge variances in reviewing. 
An individual PC member sees only a very small piece of the set of submissions; 
with large PCs we have lost the normalization across accept decisions that a 
PC-based decision allows 

• Many rejected papers are resubmitted; the high resubmission rate may be a 
leading cause of the high submission rate 

• Two recent developments, "rollover" (resubmission "with memory" between con- 
ferences) and author feed-back, have received mixed appreciation 

• Jagadish proposes founding a "Journal of Data Management Research" that 
publishes papers for participating conferences 



Reference: iLeCunl (|201Ch 
Credentials author: 

• General chair and organizer of the yearly "Learning Workshop" in Snowbird, 
Utah 

• Associate editor of PLoS ONE 

• Associate editor of the International Journal on Computer Vision 

• Program chair for NIPS '95, '94, '90, and many other conferences 
Observations: 

• Conference reviews tend to favor papers containing incremental improvements 
on well-established methods, and tend to reject papers with truly innovative 
ideas 

• Reviewers get very little credit for doing a good job with reviews and can do a 
bad job with few adverse consequences 

• The current system is breaking down due to the enormous number of papers 
submitted and the impossibility of getting papers reviewed properly 

• The current evaluation system favors citations to well-known authors 

• Lengthy and faulty evaluations is what currently holds back the dissemination 
of good papers 



Table 3: Arguments against the current conference-oriented publication model 
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Reference: Langford (2009) 
Credentials author: 

• Program chair of ICML'12 

This text summarizes arguments of a discussion at NIPS'09, where observations 
were: 

• Reviewers are overloaded, boosting the noise in decision making 

• A new system should run with as little built-in delay and friction to the process 
of research as possible 

• It is bad to take double blind so seriously as to disallow publishing on arxiv or 
personal webpages 

• Any new system should appear to outsiders as if it is the old system, or a journal, 
because it is already hard enough to justify CS tenure cases to other disciplines 

• There should not be a big change with a complex bureaucracy, but rather smaller 
changes which are obviously useful or at least worth experimenting with 

Reference: lHalpern and Parkesl i|201ll ) 
Credentials authors: 

• Editor-in-chief of the Journal of the ACM 

• Chairman of ACM Preprint 

• Computing Research Repository (CoRR) coordinator 
Observations: 

• Outside CS, there are two reasons for publishing in journals: certification and 
publicity 

• It is rare that conference reviewers review proofs as thoroughly as journal re- 
viewers; for theoretical work certification in journals remains important 

• The approaches taken by SIGGRAPH and ICLP to directly publish conference 
papers in journals suffer from the same problems that conference pbulications 
suffer from: paper are subject to page restrictions and paper submission dead- 
lines 

• The CS publication model complicates interdisciplinary research 

• Experimentation with publication models is needed 

• A system is proposed in which papers are submitted to public archives; jour- 
nals are the main "certification" authorities that take papers from these archives; 
journals are much faster in reviewing papers. To achieve fast reviewing, page lim- 
its, better coordination between conferences and journals and imposing "costs" 
on certification are possible ideas 



Table 4: Arguments against the current conference-oriented publication model 
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1) Review quality is low and highly variable. The inclusion of inexperienced 
reviewers in program committees, as well as the need to review many papers within 
a short amount of time, leads to submissions being rejected for the wrong reasons. 
Papers with good ideas get rejected because of minor flaws. This very competitive 
context tends to favor incremental contributions. 

2) The number of papers submitted for reviewing is too large. An important 
reason for this is clearly the need for researchers to publish to get funding ( "publish 
or perish"). However, the situation is significantly worsened by the conference system: 
papers that are rejected in one conference will usually be resubmitted to another 
conference, where another set of reviewers is expected to evaluate the paper again; 
contributions are split over multiple (incremental) publications to meet page limits. 

3) Acceptance for conferences is highly random. Low acceptance percentages, 
combined with variable review quality, causes acceptance to be highly random. This 
leads to frustration among authors, and decreases the quality of the conference, not 
only because less good work may be presented, but even more because it misses out 
on good work. 

4) Journal papers are often unnecessarily long. Their extension over a (se- 
ries of) conference paper(s) often consists of additions made only to make the paper 
"sufficiently different" from the previous version(s). Often, all crucial information was 
already in the conference version(s) (otherwise it would not have been accepted there). 

5) Conference papers in CS are undervalued outside and inside the held. 
Our system is not only misunderstood by many people outside the field (including, 
but not limited to, people who evaluate our research), but also increasingly within the 
field. Some areas in CS, such as bio-informatics, statistical learning, ...are moving 
towards the standard model, due to the influence of biologists, physicists, . . . This 
biases selection of papers at conferences, as well as selection of candidates for postdoc 
and tenure track positions. 

6) The status of CS journals is too low. Journals in computer science do not 
publish the work with the highest impact: by some estimates only 15% of results in 
computer science ends up in journals. The slow reviewing cycles lead to low impact 
factors, as few articles that build on earlier journal work will be published within the 2 
years that are needed to increase the most well-known impact factors. Consequently, 
journals do not have the same visibility as conferences. 

7) Authors are faced by a "conference versus journal" dilemma. Authors 
have the choice between: submitting directly to a journal (less visibility), submitting 
only to a conference, not to a journal (disadvantageous in countries where evaluation 
is based on journal publications), submitting first to a conference, then (an extended 
version) to a journal (problematic because journal articles must "significantly extend" 
conference papers) 

8) Deadline-driven research leads to worse papers, which are not as polished 
as one might hope. One might argue that these will be rejected anyway, but due 
to the variability in reviewing this is not necessarily so. In any case, submission 
of unpolished papers causes a waste of time and effort on the authors', reviewers', 
and possibly readers' side; furthermore, such papers will typically lead to incremental 
follow-up papers, which increase the reviewing load later on as well. 

9) Proliferation of conferences. When there is a higher demand for papers to 
be published than there are conferences, the number of separate conferences grows. 
People lack the time and/or money to visit all the conferences. As a result, the role 
of conferences as places where the whole community gets together is diluted. 

10) Researchers are increasingly overloaded with reviewing tasks. This 
discourages the best researchers in the field to stay actively involved. As a result, 
reviewing is often delegated to younger researchers, even PhD students. This lowers 
the quality of the reviews to an unacceptable level. 

Table 5: A summary of arguments against the current conference-oriented 
publication model 
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